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TESTING MULTIBAND AND MULTIDATE PHOTOGRAPHY 
FOR CROP IDENTIFICATION 
D.T. Lauer 

Forestry Remote Sensing Laboratory 
School of Forestry and Conservation 
University of California, Berkeley 

For several years, personnel at the Forestry Remote Sensing Laboratory have 
concentrated their efforts on developing techniques for extracting a maximum 
amount of information about vegetation resources in agricultural and wildland 
areas from aerial and space photos. Among the most significant research results 
obtained to date are our findings relating to agricultural crop surveys. Specifi- 
cally, our recent investigations regarding the i nterpretabi 1 i ty of photography 
taken in more than one spectral band and at more than one time of the year were 
so encouraging that we were able to attempt a semi-operational survey of the 1970 
small grain crop growing in Maricopa County, Arizona. The purpose of this paper 
is to describe, with the aid of three case studies, the procedures used and re- 
sults derived in a series of prerequisite interpretation tests that were performed 
on multiband and multidate photography. The results of these quantitative tests 
led to the selection of what was considered to be the best combination of multi- 
band and multidate photographs for use in the Maricopa County survey. 

The theoretical bases of the multiband and multidate concepts have been 
known for quite some time. For example, the tone or brightness with which an 
agricultural field or field condition is registered on a film emulsion is direct- 
ly related to the amount of energy reflected from that field, through the camera 
lens system, to the film emulsion. Since most terrain features or conditions 
possess unique spectral reflectance characteristics — depending on their atomic, 
molecular and physical structure — they frequently possess unique tone signatures 
when viewed on photographs taken simultaneously in more than one spectral band. 
Consequently, multiband photography obtained in those spectral bands exhibiting 
the greatest differences in signatures between crops greatly facilitates the 
task of discriminating one crop from another. Furthermore, the reflectance 
characteristics of an agricultural field rapidly change throughout a growing 
season according to noticeable changes in plant phenology and to local or regional 
cropping practices. Generally, a field progresses in development as follows: 
unprepared bare soil, prepared bare soil (plowed, disced or diked), seedling 
plants, immature plants, mature plants, harvested field. Obviously, just about 
every agricultural crop has its own distinct life cycle, and these cycles are 
easily documented in a crop calendar. By studying a crop calendar for a particu- 
lar region, one can predict when a crop might possess a unique tone signature 
when viewed on a series of photographs taken at more than one time of year. Thus, 
as is the case with multiband photography, multidate photography can aid the 
photo interpreter when trying to identify various agricultural crops. Logically, 
one could assume that both multiband and multidate photography, properly procured, 
would further enhance the interpreter's ability to perform an agricultural crop 
survey. The case studies presented below lend credence to this assumption — in 
the form of interpretation test results. 
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CASE STUDIES 


A. Mesa, Arizona 

Our Group first became involved in crop studies at the Phoenix-Mesa Test 
Site (NASA Test Site #29) while preparing for the Apollo 9 S065 mul ti spectral 
photographic experiment. A 16-square-mi le area, near Mesa, Arizona, was chosen 
for intense analysis; 125 fields within the study area included most of the 
economically important crop types found in irrigated regions of the southwest. 

In addition to the Apollo multiband photography, NASA made available high-altitude 
aircraft mul t i band-mul ti date photography for this area, and these aircraft over- 
flights occured sequentially at approximately one month intervals, beginning at 
the time of the Apollo flight. Given available multiband and multidate photo- 
graphy, a series of interpretation tests were devised to establish the best com- 
bination^) of images for identifying all crop types and single crop types with- 
in the 16-square-mi le area. 

A large number of "test images" were presented to a group of skilled inter- 
preters who were asked to classify each of the 125 fields within the study area 
into one of seven crop categories that included: barley (B) , recently cut alfalfa 
(Ac), mature alfalfa (Am), wheat (W) , sugar beets (SB), moist bare soil (BSm) , 
and dry bare soil (BSd) . Since the interpreters were not acquainted with the 
Mesa area, a photo interpretation key, in the form of training samples, was pre- 
pared. Individual fields from each crop category which represented a range in 
crop variability were selected, identified and presented to the interpreters 
(see figure l). The interpreters were asked to study the appearance of each train- 
ing sample, and once they became familiar with the identifying characteristics of 
each crop type, they attempted to correctly classify the remaining fields within 
the study area. 

In order to minimize "familiarity" with the fields within the study area, 
an interpreter was asked to look at no more than five test images. Each image 
was examined by four different interpreters, and interpretation results were ex- 
pressed as the cumulative number of fields seen by all four interpreters for 
each image. Table I shows actual interpretation results for eleven types of 
photography (i.e., various combinations of single band, multiband, single date, 
and multidate photography). The array of results shown in Table I were prepared 
in such a way as to aid the reader in comparing results derived from one image 
type with results from another. Note that each array includes ground truth, 
correct interpretations and incorrect interpretations (omission and commission 
errors). The correct interpretations, expressed in percent for all crops com- 
bined, have been summarized and are shown in Table II. 

The i nterpretabi 1 i ty of Apollo and high-flight photography (Pan-25, IR- 
89B, and Ekta Aero Infrared) were compared; and, in each case, the interpreters 
were able to identify the various crop categories field-by-field equally well 
on spaceborne and airborne photos. 

In reference to multi band and multidate photography, note that single 
band photographs taken on single dates produce fairly low overall interpretation 
results, except for the Pan-25 image taken in May. Improved results were obtain- 
ed with May photos since barley has sufficiently matured at that time allowing 
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it to be easily discriminated from all other crops. Overall interpretation 
accuracies for all crops improved impressively when single date photography, 
including the May photos, were viewed in a multiband form (i.e., Ekta Aero Infra- 
red photo or optically combined color composite image) and when single band photos 
(Pan-25) taken on two different dates were viewed in a color composite form. 

Higher results were obtained on multiband images because bare soil is most easily 
separated from vegetated fields on film containing an infrared sensitive band, and 
mature barley is best discriminated from sugar beets and alfalfa on film containing 
a red sensitive band. However, the only sure means of identifying al fal fa is by 
searching for its characteristic harvest pattern on sequential images. Since 
al fal fa is periodically mowed, changing over time from mature to recently cut to 
mature, a distinct pattern for that crop is readily seen on multidate photography. 
Consequently, mul ti band-mul tidate photography (image #1) provides the maximum 
amount of discriminatory information for identifying barley , bare soil , sugar 
beets , and al fal fa and, therefore, image #11 (three separate Ekta Aero Infrared 
photos taken in March, April, and May and viewed together) gave better overall 
interpretation results than any other form of imagery tested. 

B. Imperial Valley. California 

Concurrent with the Arizona study, an image interpretation experiment was 
being conducted in an adjacent and analogous agricultural area — Imperial Valley, 
California. As in Maricopa County, agricultural cropping in the Imperial Valley 
is mainly on reclaimed desert land where the combination of deep rich soils, an 
abundance of solar energy, and available Irrigation water has led to a level of 
agricultural productive! ty equaled in only a few parts of the world. 

Aircraft flights were arranged for this area during the summer of 1969 for 
the purpose of obtaining high quality single band, black-and-white multiband, and 
tri-emulsion color and false-color photographs. All photography was procured by 
the Science and Engineering Group at Long Island University; a boresighted multilens 
camera, equipped with Infrared sensitive film, broad-band primary color absorption 
filters, and infrared cutoff filters, was used to obtain the multiband imagery. An 
experiment was designed, utilizing quantitative interpretation tests, to determine 
the usefulness of different kinds of multi band photography (flown in July) for 
identifying four Imperial Valley cropland categories: alfalfa, sorghum, cotton and 
bare soil. 


Five sets of images were selected for testing — one set of single band 
photos (IR-25) and four sets of multiband photos (Aerial Ektachrome, Ekta Aero 
Infrared, color enhancement "A", and color enhancement "B") . Color enhancement "A", 
a close simulation of Ekta Aero Infrared film was made by optically combining an 
IR-58, IR-25 and IR-89B image projected through a blue, green and red filter, 
respectively; while color enhancement "B" was made the same way but with the green 
and red filters reversed. Part of this experiment was to compare, through inter- 
pretation testing, the information content seen on enhanced black-and-white multi- 
band photos with that seen on tri-emulsion subtractive reversal films. 

Each set of imagery was examined by three interpreters, with no interpreter 
viewing more than one set. A set of images consisted of nine separate photos 
in print form, mosaiced together showing a total of 157 agricultural 
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fields. Several fields were randomly selected within each crop category and were 
used as training samples by the photo interpreter. 

The results of the Imperial Valley Experiment are summarized in Table III 
in which test results are expressed as (1) mean percent correct identifications 
and (2) mean percent commission error — for each of the four crop categories 
and all crop categories combined. (Percent commission error for a crop category 
is the percent of the total number of fields identified as that type which were 
actually same other crop type; therefore, a low percent commission error plus 
high percent correct identification indicates high interpretation accuracy.) 

Probably what is most evident in these results is that accuracy of identi- 
fication for all crop categories combined is relatively low ( 80%), no matter 
which type of test imagery was used. These poor results are probably a function 
of the improper timing of the photo mission rather than the lack of information 
content in multiband photography, per se . An analysis of a crop calendar for 
this region would indicate that both cotton and sorghum are in a mature, green 
state of development in July — a condition rendering tone signatures for the 
two crops quite similar in appearance on single band and multiband photographs. 
The low percent eorrect identifications and high percent commission errors for 
cotton and sorghum indicate that the interpreter continually confused the two. 
Furthermore, the alfal fa fields were in any of several stages of development 
(ranging from recently cut to mature) at this single time of year which added 
to the difficulty of identifying one crop type from another. Nevertheless, some 
very prominent trends are evident in the data derived in this series of tests: 

(1) the single band black-and-white images when compared to the other four kinds 
of multi band photography, nearly always rendered the lowest percent correct 
identifications and the highest percent commission errors, (2) the color en- 
hancement "B" and Ekta Aero Infrared images tended to produce the most accurate 
results for each crop category and all crop categories combined, and (3) enough 
variability in interpretation results occurred within each group of interpreters 
working with a single type of imagery, that the significance of the results 
shown here could not be supported with statistical computations. 

In summary, one might conclude from the data presented here that an accurate 
classification of Imperial Valley crops is not easily done on photography pro- 
cured on a single day in July; however, if given the task of working with only 
July photos, multiband rather than single band (IR-25) photographs would be 
more useful for this purpose. In addition, black-and-white multiband photos 
properly procured and displayed as a color composite image can render as much 
information on crop types as conventional tri-emulsion layer color or false-color 
infrared films. 

C . Maricopa County, Arizona 

Based on the above results, it was decided that a semi-operational regional 
agricultural crop survey would be a logical extension of the interpretation tech- 
niques initially developed. An inventory of the 1970 small grain crop (i.e., 
barley and wheat) growing in Maricopa County, Arizona became the survey objective 
since mul ti band-mul tidate photographs were available for the entire area and 
reliable ground truth data had been collected by FRSL personnel during these 
overflights. Prior to implementing the survey, it was necessary to apply the 


37 


crop calendar concept and an interpretation test to determine the best combi na- 
tion(s) of multiband-multidate photographs for discriminating wheat and barley 
from all other crops, and wheat from barley. 

Studies of crop development patterns during early 1970 (data collected 
from FRSL field surveys and extracted from Arizona Crop and Livestock Reporting 
Service newsletters) indicated that the 1970 small grain crop was developing in 
a normal manner. Thus, general conclusions based on crop calendar information 
which indicated that small grains are mature and most easily distinguishable 
from other crops during the month of May, were assumed to be applicable for 1970. 
However, the studies conducted within the 16-square-mi 1 e area near Mesa, Arizona 
indicated that although barley could be consistently identified on May 21, 1970 
photos, wheat and alfalfa were sometimes confused. It was noted that the identity 
of fields in question usually could be established by noting the appearance of 
these same fields on June 28, 1970 photos. For this reason, photos taken on 
May 21 and June 28 were ultimately provided for the survey. 


In addition, the design of the previous tests, conducted in the Mesa area, 
regarding optimum film type, were not totally acceptable in terms of the survey 
for 1970. Since the 1970 photographs were taken at larger scales than the 1 96 9 
coverage (1/120,000 and 1/500,000 versus 1/950,000), giving better image resolu- 
tion, and Aerial Ektachrome coverage was omitted in 1969, it was felt that a new 
test should be made, based primarily on May 21, 1 970 photos, to determine the 
optimum film/filter combination for identifying barley and wheat. Consequently, 
five types of photography were tested for information content — three kinds of 
single band imagery (Pan-58, Pan-25 and IR-89B) and two kinds of multiband 
imagery (Aerial Ektachrome and Ekta Aero Infrared). 


Fifteen photo interpreters of equal ability were randomly placed in one of 
five three-man photo interpretation groups. Five four-square-mile test plots 
were chosen from thirty-two sample plots located throughout the county. The 
photo interpretation tests were administered so that (1) each interpreter group 
would interpret each of the five film/filter types, (2) each test plot would be 
interpreted using each of the five film/filter types, and (3) no interpreter 
group would interpret a test plot more than once. Thus each plot was interpreted 
fifteen times for a total of seventy-five interpretation tests: 


5 Test Plots X 


5 F/F Types „ 
Test Plot" X 


1 Interp. Group 3 Interpretations 
F/F Type Interp. Group 
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Procedures used for training the interpreters were similar to those used in the 
Mesa and Imperial Valley studies. In this case, four additional four-square- 
mile plots were chosen and the fields within them were used as keys or reference 
materials. After each interpreter had trained himself to interpret a particular 
film/filter combination, he began the interpretation of the test plot assigned 
to him for that combination (each interpreter examined each of the five test 
plots on a different film/filter combination). In order to ascertain the opti- 
mum film/filter combination for inventorying wheat and barley, the results of 
the tests were analyzed in three ways: (1) mean-of-ratio variance analysis, (2) 
analysis of variance for % correct, and (3) analysis of variance for % commission 
error. 


Mean-of-Rat i o Test : I 

photo interpreters were to 


n the actual crop survey, the acreage estimates by the 
be adjusted by using a mean-of-ratio estimator. 
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This estimator is defined as: 

R _ actuai acreage of wheat (or barley) 

interpretation acreage estimate for wheat (or barley) 

This estimator is calculated for each of thirty-two sample plots, the mean of 
the ratios calculated, and the acreage estimation for the entire survey area 
adjusted by multiplying by this mean. The optimum film/filter type, therefore, 
is that in which the variance of ratios is lowest, (e.g., if the interpreter 
consistently interprets 60% correct, the adjusted total will be more accurate 
than if he fluctuates between 70% and 90%). 

Variances of the ratios using each of the five film/filter types under 
consideration were tested at the 95% level of significance. No differences 
were found between the ratio variances for barley. For wheat, however, Aerial 
Ektachrome, Pan-25, and Pan-58 constituted a homogeneous sub-group of low 
variance, with Ekta Aero Infrared and Infrared-89B showing significantly higher 
variances. Thus, either Aerial Ektachrome, Pan-25 or Pan-58 would be optimum 
for the operational survey under this criterion. 

% Correct and % Commission Error Analyses : Analyses of variance were run 

to ascertain whether there were differences (at the 95% level of significance) 
between the film/filter types in terms of % correct acreage and % commission 
error (Table IV). If significant differences were found, the types were to 
be ranked using the Duncan's new multiple range test. 

The film/filter types proved to be different in terms of both % correct 
and % commission error for both barley and wheat, and hence were ranked. The 
results are illustrated in Table V. Percent correct is ranked with highest 
values at the top and % commission error with lowest values (and hence "best") 
at the top. However, types which are included within the same bracket are not 
significantly different according to Duncan's test at the 95% level of signifi- 
cance . 

Based on the results of both the mean-of-ratio analysis and the analyses 
of % correct and % commission error, Aerial Ektachrome film was chosen as the 
film/filter type to be used for the operational survey. Although in some cases 
it was not significantly superior to other film types, it was the only type 
which was at least in the superior group in ai 1 tests. (For a discussion of 
the Maricopa County survey see Draeger.et al.,1970, or Draeger, 1 971 ) . 

SUMMARY AND CONCLUSIONS 

The research reported upon above was designed to answer two questions; 

(1) cart a suitable methodology of interpretation testing be developed that 
would allow comparisons between the information content seen on various types 
of aerial and space photography? and (2) are multiband and/or multidate photo- 
graphs useful to the photo interpreter as he attempts to identify various 
agricultural crops by means of remote sensing? 
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Drawing on the large pool of skilled photo interpreters at the Forestry Re- 
mote Sensing Laboratory, an efficient and reliable interpretation testing pro- 
cedure has been developed that would be applicable to photography taken not only 
of agricultural resources but of nearly any resource environment. The technique 
consists mainly of presenting to a group of interpreters various types of photog- 
raphy on which resource patterns or conditions are to be identified. A large pop- 
ulation of resource features is required so that an interpreter never looks at a 
particular terrain object more than once — during training and testing. If sev- 
eral interpreters evaluate each type of photography, greater reliance can be 
placed on their cumulative results, which can be tabulated in various ways (e.g., 
total correct identifications, total omission errors, total commission errors, 
mean correct identifications, mean omission errors, mean commission errors) or an- 
alyzed statistically (e.g., one-way classification and Duncan's new multiple 
range test) in order to quantitatively determine the confidence which one should 
have in the results. 

Such testing procedures were then applied to multiband and/or multidate pho- 
tography taken over agricultural lands in southern California and southern Ari- 
zona. In each of these case studies involving the identification of several im- 
portant crop types, the test results indicate that multiband photography consis- 
tently yields higher interpretation accuracies than any type of single band 
photography; but more importantly, proper timing of photography — taken on more 
than one date -- will unquestionably insure a higher level of crop identification 
than that attainable with photos taken at any single point in time. 
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Map With Ground Truth (March) 



Map with Training Samples (March) 

Figure 1: The type of reference material or "photo interpretation key" used to 

train the photo interpreters is shown here (bottom map). The interpreter was 
able to familiarize himself with the image characteristics of each crop category 
by studying each training sample seen on the test image. Once he was confident 
that he could correctly identify each field, he proceeded to annotate, on the map 
with training samples, the identity of the remaining fields. Accuracy of inter- 
pretation was then calculated by comparing the annotated map with the ground 
truth map. The symbols on the maps mean: "B" for barley, "Am" for mature 

alfalfa, "Ac" for cut alfalfa, "SB" for sugar beets, "W" for wheat, "BSm" for 
moist bare soil, and "BSd" for dry bare soil (from Carneggie, et al . , 1969). 
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Total Percentage Correct Identification; 58, 


IMAGE *9 INFRARED EKTACHROME . HIGH FLIGHT 


MAY 21. 1*9 
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Total Percentage Correct Identi f ication; 72. 


IMAGE #10 MULT I DATE COLOR COMPOSITE 


FRSL OPTICAL COMOINER 
HIGH FLIGHT. MARCH 12 4 MAY 21. 1*9 
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Total Percentage Correct Identification: 76X 


IMAGE #11 HULTIBANO, MULTIDATE. 
CKTA AERO INFRARED () IMAGES) 


MARCH. APRIL AND MAY 



The array of results for each image type illustrates the cumulative results of 
four interpreters (data along rows for each type) along with the actual ground 
truth (data down the columns). For example, consider the case of barley in the 
upper left array (Image #1). First, reading down the column marked "B", out of 
a total of 131 fields known to be barley, 45 were correctly identified; however, 

45 were called mature alfalfa, 13 cut alfalfa, 17 sugar beets, 5 wheat, 5 moist 
bare soil, and 1 dry bare soil, resulting in an omission error equal to 86. 

Reading across the row marked "B", out of a total of 72 fields called barley by 
the interpreters, 45 were correctly identified; however, 13 mature alfalfa fields, 
10 cut alfalfa fields, 2 sugar beet fields and 2 wheat fields were incorrectly 
identified as barley resulting in a commission error equal to 27. Hence, out 
of a total of 131 barley fields, 45 were correctly identified yielding a percent 
correct equal to 43% (from Carneggie, et al., 1 96 9 and Pettinger, et al . , 1 96 9) . 
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TABLE II: TEST RESULTS FOR MESA, ARIZONA STUDY AREA EXPRESSED AS PERCENT 

CORRECT IDENTIFICATIONS FOR ALL CROP CATEGORIES 


TEST 

NUMBER 

INTERPRETATION 

MODE 



VEHICLE 

%C0RRECT 

1 

2 

3 

4 

5 

Single Band; 
Single Date 

Pan-25 

March 

Apollo 9 

43% 

Pan-25 

March 

Hi gh-Fl i ght 

47% 

IR-89B 

March 

Apol lo 9 

47% 

IR-89B 

March 

Hi gh-Fl i ght 

45% 

Pan-25 

May 

Hi gh-Fl i ght 

71% 

| 

Mul ti band ; 
Si ngle date 

Ekta Aero 
Infrared 

March 

Apol lo 9 

65% 

Ekta Aero 
Infrared 

March 

Hi gh-Fl i ght 

64% 

Color Composite 

Ma rch 

Hi gh-Fl i ght 

58% 

Ekta Aero 
Infrared 

May 

Hi gh-Fl i ght 

72% 

10 ** 

Single band; 
Mul tidate 

Color Composite 
Pan-25 

March and 
May 

Hi gh-Fl i ght 

76% 

1 1 

Mul t i band ; 
Mul tidate 

Ekta Aero Infra- 
red (3 images) 

March, April 
and May 

Hi gh-Fl i ght 

81% 


* A color composite image was made with the FRSL Optical Combiner Using Pan-58, 
Pan-25, and IR-89B images projected through a blue, green, and red filter, 
respectively. 

** A color composite image was made with the FRSL Optical Combiner using March 
Pan-25 and May Pan-25 images projected through a violet and green filter, 
respectively. 

(From Carneggie, et al . , 1 969 and Pettinger, et al., 1969). 
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TABLE III: TEST RESULTS FOR IMPERIAL VALLEY, CALIFORNIA STUDY AREA EXPRESSED 

AS PERCENT CORRECT IDENTIFICATIONS AND PERCENT COMMISSION ERRORS 



ALL CROPLAND 

ALFALFA 

COTTON 

SORGHUM 

BARE GROUND 

IMAGE TYPE 

% CORRECT 

%COR 

%COM 

%COR 

%COM 


%COM 

o 

o 

33 

% coh 

Enhancement B 

78 

86 

25 

51 

40 

60 

23 

84 

8 

Ekta Aero IR 

77 

77 

22 

70 

45 

44 

35 

94 

10 

Aerial Ekta 

72 

74 

25 

48 

45 

60 

43 

82 

11 

Enhancement A 

71 

73 

32 

45 

59 

35 

52 

93 

8 

IR-25 

67 

60 

30 

54 

73 

48 

38 

87 

14 
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TABLE IV: TEST RESULTS FOR MARICOPA COUNTY, ARIZONA STUDY EXPRESSED AS PERCENT 

CORRECT IDENTIFICATIONS AND PERCENT COMMISSION ERRORS 



BARLEY 

WHEAT 

IMAGE TYPE (MAY) 

%C0R. 

%C0M. 

%C0R. 

%C0M. 

Aerial Ekta. 

71 .19 

5.73 

49.25 

49.67 

Ekta Aero IR 

65.06 

24.89 

59.05 

44.73 

Pan-58 

32.35 

44.69 

38.11 

85.19 

Pan-25 

46.65 

41 .43 

20.15 

77.77 

IR-89B 

44.55 

45.40 

30.87 

77.^9 


Note: Accuracy of interpretation of wheat is significantly improved 

when the analysis is performed on May photography combined with 
June photography. 


(From Draeger, et ai . , 1970) 
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TABLE V: TYPES OF PHOTOGRAPHY RANKED (BEST AT THE TOP) AND GROUPED (WHERE SUB- 

GROUPS ARE SIGNIFICANTLY DIFFERENT) IN TERMS OF PERCENT CORRECT 
AND PERCENT COMMISSION ERROR FOR BOTH BARLEY AND WHEAT 


BARLEY INTERPRETATION 

% CORRECT 

% COMMISSION ERROR 

Aerial Ektachrome 
Ekta Aero Infrared 

* 

* 

Pan-25 

Infrared - 89B 
Pan-58 


Aerial Ektachrome 
Ekta Aero Infrared 
Pan-25 
Pan-58 

Infrared - 89B 

: 

' 


WHEAT INTERPRETATION 

% CORRECT 

% COMMISSION ERROR 

Ekta Aero Infrared 




Ekta Aero Infrared 


Aerial Ektachrome 




Aerial Ektachrome 

* 


Pan-58 




Infrared - 89B 


Infrared - 89B 




Pan-25 


Pan-25 




Pan-58 



(From Draeger, et al., 1970) 




